ADA  0 15124 


279  I'M 


Binomial  Reliability  Curves  for 
Planning  and  Assessment 

by 

D.  R.  Cruise 
G.  A.  Tabb 
I.  S.  Kurotori 

Propulsion  Development  Department 
AUGUST  1975 


Approved  for  public  rctem,  distribution  unlimited. 


Naval Weapons  Center 


CMIMA  LAM.  CALIFORNIA  93066 


national  technical 
information  service 

i | * aI  t 

< t*-  J ?**  4 


mi: ^crrtvn*Y  cr  the  nmm. 

ft.  r.  ttl,  RAdm.,  USN  GomWd* 

(?.  t..  Moiling'  /orth Technical  Director 


********** 


mmvom 

This  report  describes  an  investigation  conducted  during  the  period  January 
through  Ma/ch  1975,  sponsored  by  the  Navsi  Air  Systems  Command  under  Ain 
AS  1 OymB/SW!  1 -74-&XX)  Work  Unit  A5109E-02. 

Thh  report  has  beer,  reviewed  for  technical  accuracy  by  Wsrrer.  W.  Oshel. 


Released  by 
C.  MAPLES,  Heed 
Qmlity  Assurance  Division 

IS  1975 


Under  authority  of 
G.  W,  LEONARD,  Head 
Propulsion  Development  Department 


Published  by 
Cofhtkm 
Vua  minting 


NWC  Technical  Publication  572S 

Technical  information  Department 

Cover,  57  leaves 

2d0  arniumbered  copies 


SECURITY  CL  ASSl Fl CATION  or  THIS  RAGE  fWhm  Dm*  £*tm+Q 


REPOST  DOCUMENTATION  PAGE 


REPORT  NUMBER 

WJC  TP  5728 


REAP  INSTRUCTIONS 
BEFORE  COMPETING  FORM 


2.  GOVT  ACCESSION  NOJ  * RECIPIENT'S  CATALOG  NUMBER 


4.  title  (tnt  Subutir) 

BINOMIAL  RELIABILITY  CURVES  FOR  PLANNING  AND 
ASSESSMENT 


7.  author^*) 

U.  h.  Cruise 
G.  A.  Tabb 
I.  S.  Kurotori 


I.  “ERFORWINO  ORGANIZATION  name  and  address 

Naval  Weapons  Center 
China  Lake,  CA  93555 


C.  TYRE  OF  REPORT  E PERIOD  COVERED 

PW  ce^ist 

.fefl&wv-M****'  1975 


6.  R2RFORM4NB  ORO.  REPORT  NUMBER 


It.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

Naval  Air  Systems  Command 
Washington,  DC  20360 


tt.  REPORT  OATH 

August  1P76 


IS.  NUMBER  of  RAOES 
112 


4-  MONITORING  AGENCY  NAME  A AODRESVU  <tnt*rmt  Inm  CgoinVIlM  Olilco)  IE  SECURITY  CLASS,  (cl  <M«  MpPMj 

UNCLASSIFIED 


Ifak  DECLASSIFICATION' DOWNGRADING 
SCHEDULE 


ie  Distribution  statement  a *<•  Rrpcti) 

Approved  for  public  release;  distribution  unlimited. 


IS.  SUPPLEMENTARY  notes 


IS.  REV  WORO*  f ClUw  or.  row**  ».-«*  It  MMMT  f*xW»  hr  Ucc*  mmthrf) 

Reliability  Sample  Testing 

Confidence  Limits  Bayes  Theorem 

Binomial  Distribution  Operating  Characteristic  Curves 


20.  ABSTRACT  (C# «tLw  at  rrv+tre  t!*r  lit 

Sea  reverse  side  of  this  form. 


' au?  Urrutt  hr  hSccJt  wjkAwJ 


D©  I J*N*T»  1473  EOITION  OF  1 NOV  S3  IS  OBSOLETE 
S'*  C50I-0I4-4MI  : 

t 


UNCLASSIFIED 

SECURITY  CLASBiFICATldU  OF  Twit  P ACE  fWU«~DpF»l 


m 


UNCLASSIFIED 

-dimity  CLASSlFIOTtQH  OF  THIS  PACEfWuw  p*!m  t 


jgllffj 

Slate 


(U)  Binomial  Reliability  Curves  for  Planning  ami  Assessment,  by  D1 
R.  Cruise,  G,  A.  Tafcb,  and  I.  S.  Kurotori.  China  Lake,  Calif.,  NWC,» 
Auguat  1975.  (NWC  TP  5728,  publics! ion  UNCLASSIFIED.) 

(U)  Graphs  are  piesented  that  ( 1 ) guide  the  user  In  determining  the 
numbers  of  items  to  be  tested  to  determine  lower  reliability  limits  (RL) 
at  a confidence  level  (CL),  (2)  establish  RL  at  CL  after  testing  N (sample 
size)  items,  (3)  given  the  true  reliability,  allow  determination  of  the 
probability  of  failing  to  demonstrate  R^,  (4)  provide  an  operating  charac- 
teristic curve  for  a gjvti  N and  the  number  of  items  in  a sample  that 
pass  a given  test  (S),  (5)  establish  upper  reliability  limits,  given  N and  S, 
and  (6)  allow  utilization  of  the  Bayesian  approach. 


UNCLASSIFIED 

ttCumTr  ct**rirtCATio*i  or  ruts  *»©*<»%«*  o«* 


- we  <m#>- 


NWCTP5728 


CONTENTS 


Introduction  3 

Symbols  5 

Use  of  the  Curves 5 

Examples^ 5 

Example  I - Determination  of  RL  at  a Given  CL  5 

. Example  2 - Establishing  RL  at  CL  After  Testing  N Items  6 

Example  3 - Determination  of  the  Probability  of  Faiiing  to 

Demonstrate  at  CL,  Given  True  Reliability  6 

Example  4 - Constructing  an  Operating  Characteristic  Curve, 

Given  N unjJ  S 7 

Example  5 / Establishing  Upper  Reliability  Limits,  Given  N and  S ...  8 

j Example  (Z  - Utilising  the  Bayesian  Apptoach  8 


£= 


l 


i 


b'w* 


NWC  TP  5728 
INTRODUCTION 


A question  of  the  utmost  importance  to  the  users  of  any  weapon  is  “How 
good  is  the  item, 'weapon?".  More  specifically,  the  question  is  ‘*How  well  does  it 
perform  its  intended  function?”  or  “How  reliable  is  *he  weapon?”.  Since  weapon 
reliability  is  a function  of  design,  it  is  the  designer’s  job  to  address  this  question  and 
to  supply  the  user  with  reliability  data. 

If  each  weapon  could  be  functionally  tested,  the  problem  would  be  greatly 
simplified.  The  user  would  receive  those  passing  the  test  and  the  failures  would  be 
scrapped  or  repaired.  However,  since  most  weapons  are  one-shot  items,  100%  testing 
would  leave  nothing  for  delivery  to  the  user.  The  solution  is  to  test  a sample  from  a 
population,  then  make  predictions  (statements)  about  the  population. 

Since  the  reliability  prediction  of  the  weapon  population  is  based  on  a sample, 
uncertainty  of  the  reliability  prediction  necessarily  follows.  Of  course,  if  more  weapons 
are  tested  the  degree  of  certainty  will  increase.  This  is  where  the  term  confidence  level 
comes  to  play,  as  it  is  the  probability  that  the  reliability  prediction  is  true.  Another 
factor  that  must  be  considered  is  the  risk  involved  in  achieving  the  required  reliability 
prediction.  This  risk  is  a function  of  the  true  reliability  of  the  weapon. 

The  problem  reduces  to  (I)  what  reliability  prediction  does  the  designer  wish 
to  make  and  at  what  confidence  level,  (2)  how  many  items  should  be  tested,  and  (3) 
what  are  the  risks  involved  in  being  able  to  achieve  the  relia’  lity  prediction  at  a 
specified  confidence  level. 

This  report  presents  101  graphs  of  the  entire  spectrum  of  confidence  levels  and 
the  associated  reliabilities  for  each  sample  size  from  1 to  101.  These  graphs  (binomial 
reliability  curves)  can  be  helpful  to  managers,  engineers,  and  the  technical  planners 
during  the  time  that  reliability  decisions  are  being  formulated  and  carried  out. 

Reliability  is  shown  from  0 5 to  I.  However,  since  the  curves  for  0 to  0.5  are 
symmetrical  to  those  for  0.5  to  1,  the  reliability  for  0 to  0.5  region  may  be  read  by- 
turning  the  graphs  upside  down. 

Confidence  levels  are  given  in  percent.  In  addition  to  those  labeled,  tick  marks 
indicate  the  levels  lor  0.5.  15,  25.  35,  45,  55,  65,  75.  X5  and  99.5%.  The  scale  has 
been  stretched  ar  both  ends  to  make  it  more  readable. 

Curves  are  given  lor  each  possible  number  of  successes.  Sufficient  numbers  are 
provided  on  the  curves  to  make  each  one  easily  identifiable.  Again,  for  ihosc  numbers 
of  successes  that  result  in  a curve  entirely  below  the  0.5  reliability  level,  the  graph 
must  be  turned  upside  down. 
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Persons  knowledgeable  in  the  reliability  fieid  may  ask,  “Why  include  ridiculously 
low  reliability  and  confidence  levels  in  the  graphs?”  The  reasons  are  readily  apparent 
when  the  curves  are  used  over  the  full  spectrum  of  intended  applications.  Often, 
limited  and  restricted  tests  result  in  low  statistical  values.  Without  a full  set  of  curves, 
the  engineer  would  only  know  that  the  situation  is  bad.  With  the  curves  for  the  low 
values,  he  knows  the  exact  statistical  situation.  Also,  a full  set  of  curves  allows  a quick 
visual  analysis  or  overview  for  a given  sample  size  (up  to  101).  This  quick-look  analysis 
can  aid  managers  and  engineers  in  selecting  a sample  size  that  will  best  demonstrate 
their  requirements  and  still  be  within  budget  constraints. 

The  graphs  are  designed  for  flexibility,  maximum  readability,  and  optimum  use. 
Owen  the  sample  size  and  number  of  successes,  it  is  easy  to  determine 

1.  Lower  reliability  bounds  and  associated  confidence  levels. 

2.  Reliability  intervals  for  given  confidence  levels. 

Conversely,  given  a stated  reliability  at  a stated  confidence  level,  the  graphs  can  be 
Used  to  determine 

1.  The  number  of  successes  needed  for  a given  sample  to  meet  the  stated 
requirements. 

2.  Whether  the  ^a.uple  falls  within  predetermined  risk  limits. 

It  should  be  noted  that  similar  curves  are  published  by  Thorne1  and  tables  are 
published  by  Cooke.  However,  Thorne’s  work  was  accomplished  prior  to  the  recent 
advances  in  computer  graphic  technology,  which  arc  used  to  the  fullest  extent  in  the 
curves  published  in  this  report.  Cooke’s  work  is  recommended  when  specific  confidence 
levels  at  a high  degree  of  accuracy  are  required;  however,  the  curves  presented  herein 
are  easier  to  use  and  provide  a clearer  overall  picture  at  an  acceptable,  albeit  lower, 
accuracy  (three  places).  Also,  the  curves  are  not  restricted  to  the  specific  confidence 
levels  given  in  the  tables. 


The  following  present  a definition  of  symbols,  examples  ot  ‘he  various  uses  of 
the  curves,  and  a discussion  of  the  theory  upon  which  the  curves  are  based. 


* Naval  Missile  Center.  Rciiability  end  Confidence  Limits  foe  Sample  Testing,  by  C.  J.  Thorne 
and  R.  W.  Ciaassen.  Point  Mugu.  CA.  NMC.  April  1968.  (Report  NMC-MP68-2.) 

J Nival  Ordnance  Test  Station.  Binomial  Reliability  Table,  by  James  R.  Cooke,  Mark  T.  Lee 
sad  John  P.  Vanu^occk.  China  Uke,  CA.  NOTS.  January  1964.  (NOTS  TP  3140  (NAVWfcPS  8090)) 
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SYMBOLS 

► 

N Sample  size,  number  of  items  tested 
S Number  of  items  in  N that  pass  a given  test 

R Population  reliability,  inherent  probability  that  an  item  will  perform  its 

intended  function 

Rl  Lower  reliability  limit,  an  estimate  based  on  sample  testing 
CL  Confidence  level  that  R > Ry.  given  S and  N 
Ry  Upper  reliability  limit,  an  estimate  based  on  sample  testing 

Cy  Confidence  level  that  R < Ry.  given  S and  N 

USF.  OF  THE  CURVES 


As  stated  previously,  the  graphs  are  designed  for  l legibility,  readibility.  and 
optimum  use.  The  louowing  six  examples  of  how  to  use  the  graphs  correlate  with  the 
six  applications  listed  in  the  abstract. 


EXAMPLES 


EXAMPLE  ! DETERMINATION  OF  RL  AT  A GIVEN  C'L 

Your  warhead  development  program  has  advanced  to  the  stage  where  testing 
should  be  conducted  to  demonstrate  that  the  warhead  is  reliable.  You  want  to 
demonstrate  at  leas!  a 0.75  reliability  at  the  VQ7  confidence  level.  The  problem  then 
is  to  determine  how  many  tests  are  required  to  do  this.  By  looking  at  the  graphs,  you 
find  that  it  can  be  done  by: 

1.  Getting  8 successes  out  of  8 tests. 

(This  was  done  by  findmg  a point  defined  by  0.75  reliability  and  90G 
confidence  level  that  coincides  with  (S  = N)  and  (N).  Any  value  of  N less 
than  8 will  not  yield  the  desired  prediction.  In  a similar  manner,  subsequent 
graphs  yield  values  of  S and  N that  allow  a reliability  prediction  of  at  least 
0.75  at  the  90T  confidence  level.  Naturally,  as  N increases,  more  failures 
can  occur  and  still  allow  the  desired  reliability  to  be  demonstrated.) 

2.  Getting  13  successes  out  of  14  tests. 

3.  Getting  18  successes  out  of  20  tests 

4.  Getting  22  successes  out  of  25  tests 
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5.  Getting  26  successes  out  of  30  tests 

6.  Getting  30  successes  out  of  35  tests 

7.  Getting  34  successes  out  of  40  tests 

8.  Getting  38  successes  out  of  45  tests 

9.  Getting  42  successes  out  of  50  tests 

The  next  step  is  to  select  one  of  the  above  options.  lh,s  consideration,  which 

should  be  based  on  the  design  reliability  and  the  risk  you  wish  to  accept,  is  shown  in 

Example  3. 

EXAMPLE  2 - ES!  ABL1SH1NG  RL  AT  Cj  AFTER  TESTING  N ITEMS 

You  are  developing  a rocket  motor  and  have  fired  32  motors  with  2 failures. 

You  would  like  to  know  the  reliability  of  tie*  motor.  The  best  estimate  of  the  motor 

reliability  is,  of  course,  30/32  - .9375,  but  how  much  lower  can  the  true  motor 
reliability  be?  This  depends  On  the  confidence  ievei  with  which  you  would  like  to 
make  the  tower  reliability  limit  statement.  Using  the  N - 32  graph,  you  may  make 
statements  such  as: 

1.  You  are  90%  confident  that  the  reliability  is  at  least  0.843.  (This  is  the 
reliability  at  the  point  where  the  90%  confidence  level  intersects  the  S ~ 3u 
curve.) 

2.  You  are  80%  confident  that  the  reliability  is  at  least  U.8~’2. 

3.  You  are  70%  confident  that  the  reliability  is  at  least  0.890. 

4 You  are  60%  confident  that  the  reliability  is  at  least  0.905. 


a. 


You  are  50-%  confident  that  the  reliability  is  a! 


Fast  0.917,  etc. 


EXAMPLE  2 HE  TERMINATION  OF  THE  PROBABILITY  OF  FAILING  TO 
DEMONSTRATE  RL  AT  CL,  GIVEN  TRUE  RELIABILITY 

You  have  designed  a fuze  to  have  a reliability  of  0.99  and  wish  to  demonstrate 
that  the  reliability  is  at  least  0.90  at  the  90%  confidence  level.  You  also  wish  to  h3ve 
a small  risk  of  failing  to  demonstrate  this. 
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C onsider  two  choices.  From  Graphs  N = 22  and  N = 38,  you  can  see  that  if 
22  are  tested  without  failure  or  if  38  are  tested  with  no  more  than  1 failure,  the*  fuze 
will  have  demonstrated. a reliability  of  at  least  0.90  at  the  9091-  confidence  level;  The 
probability  of  getting  I or  more  failures  in  22  tests  when  the  true  (or  assigned) 
reliability  is  0.99  is  0.  20.  (This  probability  is  the  confidence  levei  at  the  intersection 
of  0 99  reliability  and’  the  S = 22  curve.)  The  probability  of  getting  2 or  more  failures 
m 3S  t sis  when  the  true  reliability  is  0.99  is  0.05  (where  S = 37  intersects  C^99). 
You  may  therefore  decide  to  te„t  38  fizzes  instead  of  22,  because  !!  : risk  of  failiiy;  to 
demonstrate  0.90  reliability  at  9(r;  confidence  is  4 times  greyer  with  22  samples* 
<0  20  failure  probability)  than  with  38  samples  (0.05  failure  probability). 


1 


IX  AMPLY  4 CONSTRUCTING  AN  OPERATING  CHARACTERISTIC  CUR^H* 
GIVEN  N AND  S | 

Thirty  two  igniters  have  been  produced  for  testing  to  demonstrate  reliability. 
You  do  not  know  the  true  reliability;  however,  you  would  like  to  know  (I)  \yfiat 
maximum-lower  reliability  limit  can  he  demonstrated  at  the  909?  confidence  level  jnd 
<2)  what  are  the  probabilities  of  being  able— to  do  this  as  a continuous  Junction  ol  true 

reliabilities.  • ; 

i 

1.  From  the  N = 32  graph,  the  best  that  can  be  demonstrated  at  the  9€'.? 

confidence  level  is  0.‘>3  reliability  (S  = 32  curve,  no  failures).  * 

2.  The  probabilities  as  a continuous  function  of  true  reliabilities  .are  obtained 

by  drawing  an  operating  characteristic’ctirve  from  the  S 3 32  curve  (N  - 32  graph). 
Thi%  curve  is  constructed  by  subtracting  the  confidence  level  from  100  (100  Cj  ) ^r 
.ill  reliability  values  on  the  S = 32  curve  and  plotting  as  shown  below.  100  CL  is  tjie 
probability  pf  demonstrating  0.93  reliability  at  the  909?  confidence  level.  Fqr  example, 
if  the  igniter’s  true  reliability  is  0.97.  you  have  about  a 0.37  probability  J>f 
demonstrating  0.93  reliability  at  90'/?  confidence  level.  (Compare  with  method  in 
Example  3.  which  would  show  the  probability  of  not  demonstrating  0.93  reliability  *it 
•>(/;  confidence,  to  be  - 0.63.  i.o..  the  probability  or  success  is  1.00  minus  the 
probability  of  failure.)  \ 

* 

* 
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EXAMPLE  5 ESTABLISH!^:  UPPER  RELIABILITY  LIMITS,  GIVEN  N AND  S 

* » 

A new  pyrotechnic  formulation  has  been  developed  to  Increas.  the  heat  output 
ot  a Hare  to  a required  level.  Thirty-two  flares  were  produced  from  a batch  (mix)  of  , 
this  formulation  and  tested:  3 failed  to  meet  (he  required  heat  output.  The  reliability 
requirement  on  the  heat  output  is  0.95.  With  the  given  data,  can  you  say,  with  90' ? 
confidence,  that  the  true  reliability  of  meeting  the  heat  output  is  less  than  0.95?  Go 
to  the  N = 32  graph  and  turn  it  upside  down  so  the  first  curve  on  the  left  is  labeled 
I (read  the  0 to  0.5  reliability  scale).  Go  to  the  intersection  of  909?  confidence  and 
the  curve  labeled  3 (3  is  not  labeled,  but  ! and  4 are),  then  read  the  reliability  scale 
(0  035'  This  is  equivalent  to  stating  that  the  probability  of  failure  is  at  least  0.035  at 
the  % ! confidence  level  wnich  is  the  same  as  stating  that  the  reliability  is  at  most  I 
0.035  - 0.965  at  the  90. 1 confidence  level.  Therefore,  the  reliability  that  the  flare 
will  produce  a heat  output  meeting  requirements  may.  in  fact,  be  0.95. 

However,  if  there  hau  een  5 failures,  the  reliability  would  be  at  most  0.922  at 
the  90 /confidence  level  In  this  case,  we  would  suggest  “going  back  to  the  drawing 
hoard  / |» 


EXAMPLE  6 UTILIZING  THE  I^AYESIAN  APPROACH 

I The  previous  examples  present  the  most  commonly  used  approach.  There  art 
:>J  niti.d  difficulties3  (s.c  footnote  1)  in  this  usage,  steming  from  the  fact  that  one  is 
r St  actually  sure  which  curve  to  use.  Compare  Example  2 with  Example  5 and  nob* 

: h it  different  curves  are  used  for  the  upner  and  the  lower  confidence  limits.  Actually. 
»hc  curves'  that  are  chosen  express  pessimistic  results. 

Fortunately,  the  approach  of  Bayes  and  Laplace  does  not  have  these 
difficulties.  Even  more  fortunately,  the  Bayesian  approach  may  use  these  same  graphs. 

The  correct  Bayesian  curve  is  found  by  adding  one  to  both  the  number  of 
Mil. cesses  and  the  number  of  tests  (this  is  explained  under  Theory).  Thus,  in  Example 
2.  where  30  motors  were  successfully  fired  out  of  32  attempts,  you  would  use  the 
S = 31  curve  on  the  N = 33  graph.  This  curve  crosses  the  9091  confidence  line  at  0.846. 

To  find  the  upper  confidence  limit  at  9 O'?  confidence  us  in  Example  5.  follow 
the  j usme  curve  to  the  10G  confidence  line  and  read  0.963. 

Compare  the  results  of  Examples  2.  5,  and  6 for  30  successes  in  32  tests. 

3 Vcvum,  l . s„  and  II.  O Hanley.  Hktmeirika  Tablet  for  Statisticians.  Cambridge.  England. 
<'.,mbft(ige  University  Press.  1966  Vul.  I.  pp.  83-84. 

4 Gynex,  I T •‘Confidence  Intervals  vs.  Bayesian  Intervals Presented  «r  the  International 
Svmftruum  on  fm, tula  turn  of  Probability  and  Statistics  and  Statistical  Theories  of  Science . 
t -ir**f.irv  of  We  Hern  Ontario,  Canada,  May  1973. 
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90%  point  10%  point 

(10%  in  lower  tail)  (10%  in  upper  tail) 


“Consensus”  RL  = 0.843  (Example  2)  Ry  = 0.965  (Example  5) 

Bayesian  approach  RL  - 0.846  Ry  = 0.963 

The  differences  increase  as  the  number  of  tests  decrease. 

To  find  the  proper  Bayesian  curve  for  any  of  the  applications  of  Examples  1-5, 
add  one  to  S and  N and  proceed  as  shown  in  the  examples.  Graphs  are  provided  up 
to  N — 101,  so  the  Bayesian  approach  may  be  performed  on  tests  of  up  io  100  items. 


THEORY 

Consider  the  determination  of  an  unknown  population  reliability  (R),  based  on 
the  testing  of  a sample  of  N items  randomly  drawn  from  the  population.  The 
probability  (B(j))  of  obtaining  exactly  j successes  within  the  N items  tested  is  given  by 
the  binomial  distribution 


B(j>  = 


N! 

j!(N  - j)! 


Rj(l  - R)n  J 


(1) 


S-I 

V 

The  probability  of  obtaining,  at  most,  S - 1 successes  in  the  sample  of  N is  ^ B(j). 

This  probabu.  y is  used  as  the  definition  of  the  confidence  level  that  the  reliability  is 
at  least  RL,  given  $ and  N. 


1 


s-i 


103  CL  ” £ 
)=0 


B0>  = 1 


N 

V 
j= S 


B(j) 


(2) 


Converse;, , the  confidence  level  that  the  reliability  is  at  most  Ry,  given  S and 
N defined  by 


100  C« 


N 

- £ 

j*S-H 


B(j)  = 1 


s 

£ 

ja0 


BU) 


(3) 


To  avoid  numerical  pitfalls,  the  binomial  probability  function  B(j)  was  evaluated 
via  the  evidence  function. 

E<j)  = jln(R/0  + (N  - j)  In  {(l  R)/(l  - 01  (4) 


where  f = j/N 
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The  value  of  B(j)  is  then  found  by 


B(j)  = 


jm. 


G(j)  G(N  - j) 


rre 


(5) 


where 


G<1)  = 1 


(6) 


G(j)  = j!(e/j)i  2 < j < 14 


(7) 


G(j)  = 


15  < j 


(8) 


When  j is  greater  tliar  . •,  rlings  second  order  approximation  to  the  factorial  is  used 
(this  yields  at  least  five  pace  accuracy  in  this  range).  At  values  up  to  14,  the  exact 
factorial  expression  is  used. 


This  is  not  the  only  way  in  which  the  graphical  values  could  have  been 
computed.  For  instance,  Thome  (footnote  I)  observes  that  Eq.  (2)  is  equivalent  to 


1 N! 

100  C = (S  - 1)  ! (N  - S)! 


R(S-n  (3  . R)[(N-i) 


(S-l>|  dR 


(9) 


Equation  (9)  is  of  more  than  academic  interest.  It  happens  that  this  is  the  correct 
Bayesian  estimate  of  confidence  for  (S  - I)  successes  in  a sample  size  of  {N  -1). 
Therefore,  by  suitably  choosing  N and  S,  either  the  Bayesian  or  the  consensus 
approach  is  possible  using  the  graphs  of  tlm  report. 
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FIGURE  I . Confidence  Level  and  Reliability  ior 


FIGURE  3.  Confidence  Level  and  Reliability  for  N 


FIGURE  5.  Confidence  Level  and  Reliability  for  N 


FIGURE  6.  Confidence  Level  and  Reliability  for 
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FIGURE  8.  Confidence  Level  and  Reliability  for 


FIGURE  II.  Confidence  Level  and  Reliability  for  * 
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FIGURE  13.  Confidence  Level  and  Reliability  for  N - 13. 


FIGURE  IS.  Confidence  Level  and  Reliability  for  N = IS. 
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FIGURE  16.  Confidence  Level  and  Reliability  for  N = 16. 


I-'IGURE  [9.  Confidence  Level  and  Reliability  for  N = 


FIGURE  20.  Confidence  Level  and  Reliability 
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FIGURE  21.  Confidence  Level  end  Reliability  forN  = 21. 
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FIGURE  23.  Confidence  Level  and  Reliability  for  N = 23 
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FIGURE  27.  Confideree  Level  and  Reliability 
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FIGURE  28.  Confidence  Level  and  Reliability  for  N * 28, 
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FIGURE  29.  Confidence  Level  and  Reliability  for  N - 29. 


FIGURE  30.  Confidence  Level  and  Reliability  for  N » 30. 
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FIGURE  3i.  Confidence  Level  and  Reliability 
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FIGURE  32.  Confidence  Level  and  Reliability  for  N = 32. 


NWC  TP  5728 


i©  & 

<a  ys  ^ jo  .<> 

Cl  *©  **  © '© 


O O U3  O 

o d ©J  d 


FIGURE  33.  Confidence  Level  and  Reliability  for 


FIGURE  34.  Confidence  Level  and  Reliability  for  N 
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FIGURE  37.  Confidence  Level  and  Reliability  for 
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FIGURE  38.  Confidence  Level  and  Reliability 


FIGURE  39.  Confidence  Lewi  and  Reliability  for 
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HCURfc  40,  Confidence  Level  and  Reliability  fur  > 


FIGURE  42.  Confidence  Level  and  Reliability  for  N * 42. 


FIGURE  43.  Confidence  Level  and  Reliability  for  N ■=  43. 
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FIGURE  44.  Confidence  Level  arid  Reliability  for  N 
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FIGURE  45.  Confidence  Level  and  ReliabDity  for  N * 45 
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FIGURE  47.  Confidence  Level  and  Retiability  for  N = 47. 
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FIGURE  48.  Confidence  Level  and  Reliability  for 


FIGURE  49.  Confidence  Level  and  Reliability  for 
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FIGURE  51.  Confidence  bevel  and  Reliability  for  N - 51. 


FIGURE  52.  Confidence  Level  and  Reliability  for 
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FIGURE  53.  Confidence  Levd  np<i  Reliability  for  N * S3, 


Confidence  Level  and  Reliability  for  N = 54. 
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Confidence  Level  and  Reliability  for  N * 55. 


FIGURE  56.  Confidence  Level  and  Reliability 


FIGURE  S7.  Confidence  Level  end  Reliability  for  N * 57. 


FIGURE  58.  Confidence  Level  and  Reliability  for  N = 58. 
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FIGURE  59.  C nildence  Level  and  Reliability  for  N «■  59, 
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FIGURE  60.  Confidence  Level 
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FIGURE  6J , Confidence  Uwl  wd  Reli.bility  for  N 


FIGURE  62.  Confidence  Level  and  Reliability  for 
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FIGUK£  65.  Confidence  Level  and  Reliability  for 


FIGURE  66.  Confidence  Level  and  Reliability  for  N 


-X- 

IfiKSSIf-' 
Asfeffsl- 
si®: 


O Jsj  Jai  <Q 

C)  <-i  C>  O 


NWC  TF  5728 
CONFIDENCE  LEVEL , % 

A U Ch  x!  c*> 

<a  ,o  .0  g 

Cl  O o C5  k 


-a- 


'O  1C  *<5  O O 

P>  U si  )C 

c.  ’o  ’^1  O o 


■tv  r-ir 


f A/\/ 


v ^yyrx An 

YXy^xXm 

v r , A/yu  h 


V X X V A A /V  h 
I \X  / T s'  V V rtf  Ik 

< .X  / y 4 AX/fl 

y X / j/  A A fun 

p'f'Xy  1/  /-7f/Mr 

'y^x/VYA/lk 

r ••  • -r  ■■!.••  t'/fz/f 

K .-r  - ' v a A/tjh 
f X%-  X/  r A /ty/ 

f . t -f  • r • yA'A 

y"x  x'y  A.  ym 

t .-'  ■ ' * - f A / y / A 

f , ^ '?/  7 <\i;k 

X , f A X ' A /V*  Jilt 


f /%  ff! 


<3>  Q '■£)  O O 

2 S>  N !fl  Q 

n a o $ 35 


s s s s s g 

* ’13A3T  30N30I3N03 


p tn  o 

id  csi 


FlGURf.  hi.  Conscience  Level  and  Reliability  for  't 


V 


o Jsj  p 

cs  ^ c> 


NWC  TP  5728 
CONFIDENCE  LEVEL,  % 


'O  -©  ■©  'O  o 

p p >1  p p 

O is  ^ C>  'o 


S3 

g ! v/YYl 

I I \i/Y  AY 

- ;[///'-  V 

“H  V ! 7 r ,«■ 

" \MZl 

S ; V -T  . f 
- y/> f -'t  ’ 

it-vi  r ■ 

! i//|.  i j 

f ■ /?  « r 


A > 


<'  x x y xi  A/y' a, y YAjh 

y'  A X A A A AA X A X A/Viih 
x ' y A a'  yy  A A y A A/ j h 

X ;/i,/'XAVr 

x- --T-t,- : >-i  r ■ r,?  -Tr^ u - , > i /l/y ,™ 

r 1 .-■*  A , 4 •?’  'V‘‘  A /v  xxjti 

* ; r >•  A/yx/yik 


T ••  ■ ■ J.  hi  • 

t x i 

: ‘ ; • l / /t  ; 


BTeEE 


F1GURJF-  68.  Confidence  Level  and  Reliability  for  !> 


NWC  TP  5728 


79 


F1GURK  69.  Confidence  Level  and  Reliability  for 


FIGURE  70.  Confidence  Level  and  Reliability  for  N * 70. 


FIGURE  71.  Confidence  Level  and  Reliability  for  N * 71. 
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FIGURE  72.  Confidence  Level  and  Reliability  for  N = 72. 


FIGURE  73.  Confidence  Level  and  Reliability  for  N = 73. 
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FIGURE  74.  Confidence  Level  and  Reliability  for  N = 74. 
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FIGURE  76.  Confidence  Level  and  Reliability  fo 
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FIGURE  7<!.  Confident  Lcvei  and  Reliability  for 
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FIGURE  84.  Confidence  Level  and  Reliability  for 
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FIGURE  85.  Confidence  Level  tnd  Reliability  for  N * 85. 
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FIGURE  86.  Confidence  Level  and  Reliability  for 
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FIGURE  88.  Confidence  Level  and  Reliability 
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FIGURE  90.  Confidence  Level  and  Reliability  for 
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FIGURE  95.  Confidence  Level  and  Reliability  for  N *=  95. 
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FIGURE  98.  Confidence  Level  and  Reliability 
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FIGURE  99.  Confidence  Level  and  Reliability  for  N = 99. 
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FIGURE  100.  Confidence  Level  and  Reliability  for  N = 100. 
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